Device and method for determining gesture, and computer-readable storage medium for computer program

ABSTRACT

A device for determining a gesture includes a display portion for selectively displaying one of screens; a storage portion for storing, for each of the screens, a rule used for distinguishing between gestures; a detection portion for detecting a motion made by a user; and a determination portion for identifying, from among the gestures, a gesture represented by the motion detected by the detection portion based on the rule for a current screen, the current screen being one of the screens and being displayed at a time when the motion has been detected.

This application is based on Japanese patent application No. 2013-061386filed on Mar. 25, 2013, the contents of which are hereby incorporated byreference.

BACKGROUND OF THE INVENTION 1. Field of the Invention

The present invention relates to a technology for determining gesturessuch as tap and flick.

2. Description of the Related Art

As technologies for touch-sensitive panels have been recently improved,a variety of gestures such as tap, press, double tap, flick, drag,pinch-in, and pinch-out can be made on such touch-sensitive panels.Further, a device called a “3D gesture input device” or “3D motion inputdevice” for detecting a gesture in a three-dimensional space has startedto become available.

Selective use of gestures enables users to enter data and commands moreeasily than is conventionally possible.

On the other hand, increase in gesture often causes a computer to failto recognize a gesture correctly as intended by a user.

To address this, there have been technologies described below toprecisely determine gestures. According to the first technology, whentouch-up is performed before a time period T counted by a timer exceedsa predetermined time period Tmax, a CPU calculates a variance S of touchpositions based on coordinate information on each of touch positionsstored in a memory. When calculated variances Sx and Sy are smaller thanthresholds Sxmax and Symax respectively, the CPU determines that theinput operation does not include a move, that is to say, that the inputoperation is tap operation. When the calculated variances Sx and Sy arenot smaller than the thresholds Sxmax and Symax respectively, the CPUdetermines that the input operation includes a move, which means thatthe input operation is drag operation or flick operation (JapaneseLaid-open Patent Publication No. 2011-134212).

According to the second technology, even after contact time for inputoperation performed on an operation surface is acquired, it is checkedwhether or not an operation object is placed on the operation surface.When the operation object is placed, the input operation is determinedto be touch operation. When the operation object is not placed, theinput operation is determined to be tap operation (Japanese Laid-openPatent Publication No. 2007-156634).

According to the third technology, a reference speed is set inaccordance with a travel distance or a travel time of a pointer such asa stylus and fingers. Based on the reference speed and a travel speed ofthe pointer, it is determined whether or not flick operation by thepointer is made (Japanese Laid-open Patent Publication No. 2012-128830).

It is difficult for humans to perform the same motion all the time. Evenwhen a user intends to make the same gesture every time, there is noguarantee that a computer determines that the same gesture is made everytime. As a result, a device performs processing not intended by theuser, which is sometimes disadvantageous to him/her. Such a system issometimes hard to use for the user.

SUMMARY

The present invention has been achieved in light of such an issue, andan object thereof is to bring more benefits to users of a deviceperforming processing based on a gesture than with the conventionalmethods.

According to one aspect of the present invention, a device fordetermining a gesture includes a display portion configured toselectively display one of screens; a storage portion configured tostore, for each of the screens, a rule used for distinguishing betweengestures; a detection portion configured to detect a motion made by auser; and a determination portion configured to identify, from among thegestures, a gesture represented by the motion detected by the detectionportion based on the rule for a current screen, the current screen beingone of the screens and being displayed at a time when the motion hasbeen detected.

These and other characteristics and objects of the present inventionwill become more apparent by the following descriptions of preferredembodiments with reference to drawings.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a diagram showing an example of the overall configuration ofan intranet.

FIG. 2 is a diagram showing an example of the hardware configuration ofan image forming apparatus.

FIG. 3 is a diagram showing an example of the functional configurationof an image forming apparatus.

FIG. 4 is a diagram showing an example of tap threshold data.

FIG. 5 is a flowchart depicting an example of the flow of processing fordistinguishing between tap and flick.

FIG. 6 is a diagram showing an example of a document transmissionscreen.

FIG. 7 is a diagram showing an example of a job history check screen.

FIGS. 8A and 8B are diagrams showing an example of the determinationresult of tap and the determination result of flick on ascreen-by-screen basis.

FIG. 9 is a diagram showing a modification of the functionalconfiguration of an image forming apparatus.

FIG. 10 is a diagram showing an example of press threshold data.

FIG. 11 is a flowchart depicting an example of the flow of processingfor distinguishing between press and drag.

FIG. 12 is a diagram showing an example of a box document output screenbefore a press gesture is made.

FIG. 13 is a diagram showing an example of a job history check screenbefore a press gesture is made.

FIG. 14 is a diagram showing an example of a box document output screenafter a press gesture is made.

FIG. 15 is a diagram showing an example of a job history check screenafter a press gesture is made.

FIGS. 16A and 16B are diagrams showing an example of the determinationresult of press and the determination result of drag on ascreen-by-screen basis.

FIG. 17 is a diagram showing a modification of the functionalconfiguration of an image forming apparatus.

FIG. 18 is a diagram showing an example of air tap threshold data.

FIG. 19 is a flowchart depicting an example of the flow of processingfor distinguishing between air tap and air flick.

FIGS. 20A and 20B are diagrams showing an example of the determinationresult of air tap and the determination result of air flick on ascreen-by-screen basis.

FIG. 21 is a flowchart depicting a modification of the flow ofprocessing for distinguishing between tap and flick.

DESCRIPTION OF THE PREFERRED EMBODIMENTS First Embodiment

FIG. 1 is a diagram showing an example of the overall configuration ofan intranet 3. FIG. 2 is a diagram showing an example of the hardwareconfiguration of an image forming apparatus 1. FIG. 3 is a diagramshowing an example of the functional configuration of the image formingapparatus 1.

As shown in FIG. 1, the intranet 3 is configured of the image formingapparatus 1, terminals 2, a communication line 3NW, and so on. The imageforming apparatus 1 is configured to perform communication with theterminals 2 via the communication line 3NW. Examples of thecommunication line 3NW are a public line, a dedicated line, theInternet, and a Local Area Network (LAN).

The image forming apparatus 1 is an apparatus that is generally called a“Multi-Functional Peripheral (MFP)” or a “multifunction device”. Theimage forming apparatus 1 is an apparatus into which functions such ascopying, network printing, scanning, faxing, box function, and a mailerfunction are consolidated.

The “network printing function” is to print an image onto paper based onimage data received from the terminal 2. The network printing functionis sometimes called a “network printer function” or “PC print function”.

According to the “box function”, a storage area called a “box” or“personal box” is allocated to each user. The box function enables eachuser to save data, e.g., image data, to his/her storage area and tomanage the same therein. The box corresponds to a “folder” or“directory” in a personal computer.

Referring to FIG. 2, the image forming apparatus 1 is configured of acentral processing device 10 a, a Random Access Memory (RAM) 10 b, aRead Only Memory (ROM) 10 c, a large-capacity storage 10 d, atouch-sensitive panel display 10 e, a hardware key panel 10 f, a NetworkInterface Card (NIC) 10 g, a modem 10 h, a scanner unit 10 i, an imagememory portion 10 j, an image processing unit 10 k, a printing unit 10m, a video camera 10 n, and so on.

The touch-sensitive panel display 10 e selectively displays, forexample, a screen for presenting messages to a user, a screen forshowing the results of processing, and a screen for allowing a user toinput data and commands to be given to the image forming apparatus 1.The touch-sensitive panel display 10 e detects a position touched by auser and informs the central processing device 10 a of the touchedposition.

The hardware key panel 10 f includes a numeric keypad, a start key, astop key, and a function key.

A user operates the touch-sensitive panel display 10 e or the hardwarekey panel 10 f to give commands to the image forming apparatus 1 andenter data thereto. Such commands and data can be entered by, inparticular, making touch gestures of tap, press (sometimes called “longtap”), flick, drag, and so on. The touch gestures may be made bytouching a display surface of the touch-sensitive panel display 10 ewith finger and moving the finger in a predetermined manner on thedisplay surface without losing contact.

The NIC 10 g performs communication with the terminal 2 and so on inaccordance with a protocol such as Transmission ControlProtocol/Internet Protocol (TCP/IP).

The modem 10 h performs communication with a facsimile terminal inaccordance with a protocol such as G3.

The scanner unit 10 i optically reads a document image such as text,picture, graphics, or chart recorded on a sheet of paper, and generatesimage data thereof.

The image memory portion 10 j stores the image data captured by thescanner unit 10 i. The image memory portion 10 j also stores image datareceived by the NIC 10 g or the modem 10 h.

The image processing unit 10 k performs image processing, e.g., upsidedown correction, inclination correction, smudge removal, or resolutionconversion on the image data stored in the image memory portion 10 j.

The printing unit 10 m prints, onto paper, a document image based on theimage data stored in the image memory portion 10 j.

The video camera 10 n is a device to record the movement of a userfinger, and is used to identify the type of an air gesture. The airgesture is sometimes called a “3D gesture” or “three-dimensionalgesture”.

The ROM 10 c or the large-capacity storage 10 d stores, therein, aprogram for implementing the functions of a gesture analyzing portion101, a screen display control portion 102, and a job execution controlportion 103, all of which are shown in FIG. 3. The program is loadedinto the RAM 10 b as necessary, and is executed by the centralprocessing device 10 a.

The large-capacity storage 10 d may be, for example, a hard disk or anon-volatile storage medium such as a Solid State Drive (SSD). Thecentral processing device 10 a may be, for example, a Central ProcessingUnit (CPU) or a Micro Processing Unit (MPU).

The gesture analyzing portion 101 is configured of a tap thresholdstorage portion 121, a tap threshold read-out portion 122, a motioncharacteristics information obtaining portion 123, a distance comparisonportion 124, a time comparison portion 125, a gesture identifyingportion 126, and so on. The gesture analyzing portion 101 determineswhich gesture user's operation made on the touch-sensitive panel display10 e corresponds to.

In particular, according to the first embodiment, the gesture analyzingportion 101 determines whether a touch gesture represented by operation(motion) on the touch-sensitive panel display 10 e is tap or flick. Thedetermination is made based on conditions corresponding to a screendisplayed at a time when the motion was made. Hereinafter, such a screenis referred to as a “current screen”.

The terminal 2 shown in FIG. 1 is a client with which a user usesfunctions provided by the image forming apparatus 1. Examples of theterminal 2 are a personal computer, a smartphone, a tablet computer, anda mobile phone terminal.

The description goes on to functions of the portions of the gestureanalyzing portion 101 in the image forming apparatus 1 shown in FIG. 3with reference to flowcharts, and so on.

FIG. 4 is a diagram showing an example of tap threshold data 5PD. FIG. 5is a flowchart depicting an example of the flow of processing fordistinguishing between tap and flick. FIG. 6 is a diagram showing anexample of a document transmission screen 61. FIG. 7 is a diagramshowing an example of a job history check screen 62. FIGS. 8A and 8B arediagrams showing an example of the determination result of tap and thedetermination result of flick on a screen-by-screen basis.

As shown in FIG. 4, the tap threshold storage portion 121 stores,therein, tap threshold data 5PD on a screen-by-screen basis. The tapthreshold data 5PD indicates a screen identifier Gi, a distancethreshold Dmax_a, and a time threshold Tmin_a.

The screen identifier Gi is an identifier for identifying a screen. Thedistance threshold Dmax_a and the time threshold Tmin_a are thresholdsused to distinguish between tap and flick.

When the touch-sensitive panel display 10 e detects a touch with onefinger, the tap threshold read-out portion 122 through the gestureidentifying portion 126 perform processing in a manner as shown in FIG.5.

The tap threshold read-out portion 122 reads out tap threshold data 5PDon the current screen from the tap threshold storage portion 121 (Step#701).

The motion characteristics information obtaining portion 123 obtainsmotion characteristics data 5MT indicating a period of time during whichthe touch has been made (hereinafter, such a period of time beingreferred to as a “duration of touch Ta”) and a finger movement distance(hereinafter, referred to as a “travel distance Da”) based on the resultof detection of the touch by the touch-sensitive panel display 10 e.

The distance comparison portion 124 compares the travel distance Daindicated in the motion characteristics data 5MT with a distancethreshold Dmax_a indicated in the tap threshold data 5PD, and judgeswhether or not the travel distance Da is smaller than the distancethreshold Dmax_a (Step #703).

If the travel distance Da is smaller than the distance threshold Dmax_a(Yes in Step #704), then the time comparison portion 125 compares theduration of touch Ta indicated in the motion characteristics data 5MTwith a time threshold Tmin_a indicated in the tap threshold data 5PD,and judges whether not the duration of touch Ta is greater than the timethreshold Tmin_a (Step #705).

The gesture identifying portion 126 determines a touch gesturerepresented by the motion on the touch-sensitive panel display 10 e inaccordance with the results of determination by the distance comparisonportion 124 and the time comparison portion 125. The gesture identifyingportion 126 determines as follows: If the travel distance Da is smallerthan the distance threshold Dmax_a, and at the same time, if theduration of touch Ta is greater than the time threshold Tmin_a (Yes inStep #706), then the gesture identifying portion 126 determines that thetouch gesture represented by the motion is tap (Step #707). On the otherhand, if the travel distance Da is equal to or greater than the distancethreshold Dmax_a (No in Step #704), or, alternatively, if the durationof touch Ta is equal to or smaller than the time threshold Tmin_a (No inStep #706), then the gesture identifying portion 126 determines that thetouch gesture represented by the motion is flick (Step #708).

The description goes on to a difference between the determinationresults of touch gestures while a comparison is made between a casewhere the document transmission screen 61 shown in FIG. 6 is displayedand a case where the job history check screen 62 shown in FIG. 7 isdisplayed.

The document transmission screen 61 is used for a user to enterconditions and commands for a document transmission job. The “documenttransmission job” is a job of reading a document image from paper,converting the document image into electronic data, and sending theresultant to a destination designated by a user via facsimile orelectronic mail.

The document transmission screen 61 has a destination designation area61 e. The destination designation area 61 e has select buttons 61 bcorresponding to electronic mail addresses and facsimile numbersregistered in advance in an address book. When the address book has manyrecords of electronic mail addresses and facsimile numbers, the selectbuttons 61 b for all the records cannot be laid out at one time in thedestination designation area 61 e. In such a case, only some of theselect buttons 61 b (fifteen buttons in the illustrated example of FIG.6) are laid out. In response to a predetermined touch gesture, thedestination designation area 61 e is scrolled through, so that the otherselect buttons 61 b are laid out in order in the destination designationarea 61 e.

The user flicks the surface at any position in the destinationdesignation area 61 e, which causes the destination designation area 61e to be scrolled. The user can select an electronic mail address or afacsimile number to which a target document is to be sent by tapping aselect button 61 b corresponding to the electronic mail address or thefacsimile number.

While the user considers to have made a flick gesture, the image formingapparatus 1 possibly detects that a select button 61 b was tapped. Thissituation is not preferable because if the user does not find theincorrect detection by the image forming apparatus 1, the targetdocument is inadvertently sent to an unintended recipient. In comparisonwith the situation, the following is less undesirable: When the userconsiders to have made a tap gesture, the image forming apparatus 1erroneously detects that a flick gesture was made.

For a tap gesture, in essence, the user should keep touching only oneposition on the touch-sensitive panel display. However, even if thetouch position changes by a distance corresponding to even one dot, thegesture is regarded as flick rather than tap, which makes it difficultfor the user to make a tap gesture. To address this, in general, astandard value (maximum value) of change in position tolerated as tap ispreset. Hereinafter, the maximum value is referred to as a “distancedefault maximum value Do_a”.

In general, a period of time during which the touch-sensitive paneldisplay is touched is longer for a flick gesture than for a tap gesture.Hereinafter, a preset intermediate value between a typical length oftime period during which the touch-sensitive panel display is touchedfor a tap gesture and a typical length of time period during which thetouch-sensitive panel display is touched for a flick gesture is referredto as a “time default minimum value To_a”.

For the reasons set forth above, while the document transmission screen61 is displayed, a tendency in which a gesture made by the user isdetermined to be flick is preferably higher than usual.

In view of this, a value smaller than the distance default maximum valueDo_a is preset, as the distance threshold Dmax_a, in the tap thresholddata 5PD (see FIG. 4) for the document transmission screen 61. Further,a value greater than the time default minimum value To_a is preset asthe time threshold Tmin_a.

Hereinafter, the distance threshold Dmax_a and the time threshold Tmin_afor the document transmission screen 61 are a “distance threshold d61”and a “time threshold t61”, respectively.

In contrast, FIG. 7 shows the job history check screen 62 on which theuser checks a history of jobs executed previously by the image formingapparatus 1.

The job history check screen 62 has a job list area 62 e in which selectbuttons 62 b corresponding to jobs are provided in descending order fromthe newest job to the oldest job. When there are many job records, theselect buttons 62 b for all the job records cannot be laid out at onetime in the job list area 62 e. In such a case, only some of the selectbuttons 62 b (seven buttons in the example of FIG. 7) are laid out. Inresponse to predetermined operation, the job list area 62 e is scrolledthrough, so that the other select buttons 62 b are laid out in order inthe job list area 62 e.

The user flicks upwardly or downwardly the surface at any position inthe job list area 62 e, which causes the job list area 62 e to bescrolled. In order to display a screen showing the details of attributesof a job (execution conditions, command source, etc.), the user taps aselect button 62 b corresponding to the job.

The user usually checks the details of a new job rather than an old job.Accordingly, a tap gesture is probably made more often than a flickgesture on the job history check screen 62.

In view of this, a value greater than the distance threshold Dmax_aindicated in the tap threshold data 5PD for the document transmissionscreen 61 (namely, the distance threshold d61) is set, as distancethreshold Dmax_a, in tap threshold data 5PD for the job history checkscreen 62. Alternatively, it is possible to set a value greater than thedistance default maximum value Do_a.

A value smaller than the time threshold Tmin_a indicated in the tapthreshold data 5PD for the document transmission screen 61 (namely, thetime threshold t61) is set, as time threshold Tmin_a, in the tapthreshold data 5PD for the job history check screen 62. Alternatively,it is possible to set a value smaller than the time default minimumvalue To_a.

Hereinafter, the distance threshold Dmax_a and the time threshold Tmin_afor the job history check screen 62 are refereed to as a “distancethreshold d62” and a “time threshold t62”, respectively.

As discussed above, the distance threshold d62 is greater than thedistance threshold d61. The time threshold t62 is smaller than the timethreshold t61. Therefore, according to the processing shown in FIG. 5,it is more often determined that a gesture made by the user is flick ina case where the document transmission screen 61 is displayed than in acase where the job history check screen 62 is displayed. This is knownfrom the comparison between FIG. 8A and FIG. 8B. Further, it is moreoften determined that a gesture made by the user is tap in the casewhere the job history check screen 62 is displayed than in the casewhere the document transmission screen 61 is displayed. This is alsoknown from the comparison between FIG. 8A and FIG. 8B.

When a screen to which no tap threshold data 5PD is given is displayed,the gesture analyzing portion 101 analyzes what kind of gesture isrepresented by a motion on the touch-sensitive panel display 10 e byconventional methods based on the distance default maximum value Do_a orthe time default minimum value To_a. When a screen to which the tapthreshold data 5PD is given, i.e., the document transmission screen 61or the job history check screen 62, is displayed, gestures other thantap and flick are analyzed through the conventional methods.

Referring back to FIG. 3, the screen display control portion 102 and thejob execution control portion 103 perform processing based on thegesture determined by the gesture analyzing portion 101 and a targetthereof (hereinafter, referred to as “operation details”) in thefollowing manner.

The screen display control portion 102 scrolls through or makes a changeon the current screen depending on the operation details.

The job execution control portion 103 controls the hardware depicted inFIG. 2 in such a manner that a variety of jobs are executed inaccordance with the operation details.

The screen display control portion 102 and the job execution controlportion 103 may be implemented by the existing operating system,firmware, or application programs.

According to the first embodiment, it is possible to distinguish betweentap and flick on a screen-by-screen basis more appropriately than isconventionally possible. This causes less inconvenience to users thanwith conventional methods, or, improves the user-friendliness ascompared to conventional methods.

Second Embodiment

FIG. 9 is a diagram showing a modification of the functionalconfiguration of the image forming apparatus 1. FIG. 10 is a diagramshowing an example of press threshold data 5PE. FIG. 11 is a flowchartdepicting an example of the flow of processing for distinguishingbetween press and drag. FIG. 12 is a diagram showing an example of a boxdocument output screen 63 before a press gesture is made. FIG. 13 is adiagram showing an example of a job history check screen 64 before apress gesture is made. FIG. 14 is a diagram showing an example of thebox document output screen 63 after a press gesture is made. FIG. 15 isa diagram showing an example of the job history check screen 64 after apress gesture is made. FIGS. 16A and 16B are diagrams showing an exampleof the determination result of press and the determination result ofdrag on a screen-by-screen basis.

In the first embodiment, the image forming apparatus 1 determineswhether a touch gesture is tap or flick based on thresholds depending onthe current screen. In the second embodiment, the image formingapparatus 1 determines whether a touch gesture is press or drag based onthresholds depending on the current screen.

The configuration of the intranet 3 according to the second embodimentis the same as that of the first embodiment shown in FIG. 1. Thehardware configuration and functional configuration of the image formingapparatus 1 in the second embodiment are basically the same as those ofthe first embodiment shown in FIG. 2 and FIG. 3, respectively. Notehowever that, as shown in FIG. 9, the gesture analyzing portion 101 isconfigured of a press threshold storage portion 131, a press thresholdread-out portion 132, a motion characteristics information obtainingportion 133, a distance comparison portion 134, a time comparisonportion 135, a gesture identifying portion 136, and so on.

The description goes on to functions of the portions of the gestureanalyzing portion 101 with reference to the flowchart of FIG. 11, and soon. Description of points common to the first embodiment shall beomitted.

As shown in FIG. 10, the press threshold storage portion 131 stores,therein, press threshold data 5PE on a screen-by-screen basis. The pressthreshold data 5PE indicates a screen identifier Gi, a distancethreshold Dmax_b, and a time threshold Tmin_b. The distance thresholdDmax_b and the time threshold Tmin_b are thresholds used to distinguishbetween press and drag.

When the touch-sensitive panel display be detects a touch with onefinger, the press threshold read-out portion 132 through the gestureidentifying portion 136 perform processing in a manner as shown in FIG.11.

The press threshold read-out portion 132 reads out press threshold data5PE on the current screen from the press threshold storage portion 131(Step #721).

The motion characteristics information obtaining portion 133 obtainsmotion characteristics data 5MU indicating a period of time during whichthe touch has been made (hereinafter, such a period of time beingreferred to as a “duration of touch Tb”) and a finger movement distance(hereinafter, referred to as a “travel distance Db”) (Step #722).

The distance comparison portion 134 compares the travel distance Dbindicated in the motion characteristics data 5MU with a distancethreshold Dmax_b indicated in the press threshold data 5PE, and judgeswhether or not the travel distance Db is smaller than the distancethreshold Dmax_b (Step #723).

If the travel distance Db is smaller than the distance threshold Dmax_b(Yes in Step #724), then the time comparison portion 135 compares theduration of touch Tb indicated in the motion characteristics data 5MUwith a time threshold Tmin_b indicated in the press threshold data 5PE,and judges whether or not the duration of touch Tb is greater than thetime threshold Tmin_b (Step #725).

The gesture identifying portion 136 identifies the type of a touchgesture represented by the operation (motion) on the touch-sensitivepanel display 10 e in accordance with the results of determination bythe distance comparison portion 134 and the time comparison portion 135.The gesture identifying portion 136 determines as follows: If the traveldistance Db is smaller than the distance threshold Dmax_b, and at thesame time, if the duration of touch Tb is greater than the timethreshold Tmin_b (Yes in Step #726), then the gesture identifyingportion 136 determines that the touch gesture represented by the motionis press (Step #727). On the other hand, if the travel distance Db isequal to or greater than the distance threshold Dmax_b (No in Step#724), or, alternatively, if the duration of touch Tb is equal to orsmaller than the time threshold Tmin_b (No in Step #726), then thegesture identifying portion 136 determines that the touch gesturerepresented by the motion is drag (Step #728).

The description goes on to a difference between the determinationresults of touch gestures while a comparison is made between a casewhere the box document output screen 63 shown in FIG. 12 is displayedand a case where the job history check screen 64 shown in FIG. 13 isdisplayed.

The box document output screen 63 is used for a user to enter commandsfor a box document transmission job or a box document print job. The“box document transmission job” is a job of sending a document saved inthe form of image data in a box to another device. The “box documentprint job” is a job of printing out a document saved in the form ofimage data in a box onto paper.

The box document output screen 63 has a document designation area 63 e.The document designation area 63 e has select icons 63 b correspondingto documents saved in the form of image data in a box. When manydocuments are registered, the select icons 63 b for all the documentscannot be laid out at one time in the document designation area 63 e. Insuch a case, only some of the select icons 63 b (eight icons in theillustrated example of FIG. 12) are laid out. In response to apredetermined touch gesture, the document designation area 63 e isscrolled through, so that the other select icons 63 b are laid out inorder in the document designation area 63 e.

The user drags the surface at any position in the document designationarea 63 e, which causes the document designation area 63 e to bescrolled.

The user gives the image forming apparatus 1 a command for a boxdocument transmission job or a command for a box document print job viaa press gesture and a drag and drop gesture in the following manner.

The user makes a press gesture on a select icon 63 b corresponding to adocument to be sent or to be printed. At this time point, however, theuser does not release the finger from the touch-sensitive panel display10 e. In short, the user keeps touching the select icon 63 b for apredetermined period of time or longer. In response to this operation,as shown in FIG. 14, two job icons 63 i 1 and 63 i 2 appear in un upperpart of the document designation area 63 e. The job icon 63 i 1corresponds to a box document transmission job. The job icon 63 i 2corresponds to a box document print job. In order to give a command toexecute a box document transmission job, the user drags and drops theselect icon 63 b onto the job icon 63 i 1. In order to give a command toexecute a box document print job, the user drags and drops the selecticon 63 b onto the job icon 63 i 2.

When the select icon 63 b is dropped onto the job icon 63 i 1, imagedata on a document corresponding to the select icon 63 b is sent toanother device. On the other hand, when the select icon 63 b is droppedonto the job icon 63 i 2, a document corresponding to the select icon 63b is printed onto paper.

While the user considers to have only made a drag gesture, the imageforming apparatus 1 possibly detects that a select icon 63 b waspressed, and then, dragged. This situation is not preferable. This isbecause the target document is possibly sent to an unintended recipientinadvertently, or, unnecessary printing is possibly carried out. Incomparison with the situation, the following is less undesirable: Whenthe user considers to have made a press gesture, and then have made adrag gesture, the image forming apparatus 1 erroneously detects thatonly a drag gesture was made.

For a press gesture, in essence, as with the case of a tap gesture, theuser should keep touching only one position on the touch-sensitive paneldisplay. However, even if the touch position changes by a distancecorresponding to even one dot, the gesture is regarded as drag ratherthan press, which makes it difficult for the user to make a pressgesture. To address this, in general, a standard value (maximum value)of change in position tolerated as press is preset. Hereinafter, themaximum value is referred to as a “distance default maximum value Do_b”.

In general, a period of time during which the touch-sensitive paneldisplay is touched is longer for a drag gesture than for a pressgesture. Hereinafter, a preset intermediate value between a typicallength of time period during which the touch-sensitive panel display istouched for a press gesture and a typical length of time period duringwhich the touch-sensitive panel display is touched for a drag gesture isreferred to as a “time default minimum value To_b”.

For the reasons set forth above, while the box document output screen 63is displayed, a tendency in which a gesture represented by user motionis determined to be only a drag gesture rather than a combined gestureof press and drag is preferably higher than usual.

In view of this, a value smaller than the distance default maximum valueDo_b is preset, as the distance threshold Dmax_b, in the press thresholddata 5PE (see FIG. 10) for the box document output screen 63. Further, avalue greater than the time default minimum value To_b is preset as thetime threshold Tmin_b.

Hereinafter, the distance threshold Dmax_b and the time threshold Tmin_bfor the box document output screen 63 are a “distance threshold d63” anda “time threshold t63”, respectively.

In contrast, FIG. 13 shows the job history check screen 64 on which theuser checks a history of jobs executed previously by the image formingapparatus 1 as with the job history check screen 62 (refer to FIG. 7).

The configuration of the job history check screen 64 is basically thesame as that of the job history check screen 62. To be specific, the jobhistory check screen 64 has a job list area 64 e in which select buttons64 b corresponding to jobs are provided in descending order from thenewest job to the oldest job. When there are many job records, only someof the select buttons 64 b are laid out. In response to predeterminedoperation, the job list area 64 e is scrolled through, so that the otherselect buttons 64 b are laid out in order in the job list area 64 e.

Note that a gesture for scrolling through the job list area 64 e and agesture for selecting a job are different from those on the job historycheck screen 62.

The user drags upwardly or downwardly the surface at any position in thejob list area 64 e, which causes the job list area 64 e to be scrolled.

In order to display a screen showing job details, the user performs thefollowing operation.

The user makes a press gesture with a finger on a select button 64 bcorresponding to a job of which the details are to be checked. At thistime point, however, the user does not release the finger from thetouch-sensitive panel display 10 e. In short, the user keeps touchingthe select button 64 b for a predetermined period of time or longer. Inresponse to this operation, as shown in FIG. 15, a details icon 64 iappears in an upper part of the job list area 64 e. The user drags anddrops the select button 64 b onto the details icon 64 i.

As described above, the user usually checks the details of a new jobrather than an old job. Accordingly, a combined gesture of press anddrag is probably made more often than a press gesture only on the jobhistory check screen 64.

In view of this, a value greater than the distance threshold Dmax_bindicated in the press threshold data 5PE for the box document outputscreen 63 (namely, the distance threshold d63) is set, as distancethreshold Dmax_b, in press threshold data 5PE for the job history checkscreen 64. Alternatively, it is possible to set a value greater than thedistance default maximum value Do_b.

A value smaller than the time threshold Tmin_b indicated in the pressthreshold data 5PE for the box document output screen 63 (namely, thetime threshold t63) is set, as time threshold Tmin_b, in the pressthreshold data 5PE for the job history check screen 64. Alternatively,it is possible to set a value smaller than the time default minimumvalue To_b.

Hereinafter, the distance threshold Dmax_b and the time threshold Tmin_bfor the job history check screen 64 are refereed to as a “distancethreshold d64” and a “time threshold t64”, respectively.

As discussed above, the distance threshold d64 is greater than thedistance threshold d63. The time threshold t64 is smaller than the timethreshold t63. Therefore, according to the processing shown in FIG. 11,it is more often determined that a gesture made by the user is drag in acase where the box document output screen 63 is displayed than in a casewhere the job history check screen 64 is displayed. This is known fromthe comparison between FIG. 16A and FIG. 16B. Further, it is more oftendetermined that a gesture made by the user is tap in the case where thejob history check screen 64 is displayed than in the case where the boxdocument output screen 63 is displayed. This is also known from thecomparison between FIG. 16A and FIG. 16B.

Referring back to FIG. 9, the screen display control portion 102 and thejob execution control portion 103 operate in a manner similar to thosein the first embodiment. Note that, as the result of determination ofthe touch gesture, the result of determination by the gestureidentifying portion 136 is used.

According to the second embodiment, it is possible to distinguishbetween press and drag on a screen-by-screen basis more appropriatelythan is conventionally possible. This causes less inconvenience to usersthan with conventional methods, or, improves the user-friendliness ascompared to conventional methods.

Third Embodiment

FIG. 17 is a diagram showing a modification of the functionalconfiguration of the image forming apparatus 1. FIG. 18 is a diagramshowing an example of air tap threshold data 5PF. FIG. 19 is a flowchartdepicting an example of the flow of processing for distinguishingbetween air tap and air flick. FIGS. 20A and 20B are diagrams showing anexample of the determination result of air tap and the determinationresult of air flick on a screen-by-screen basis.

In the first and second embodiments, the image forming apparatus 1identifies a gesture made by a user based on change in position touchedon the display surface of the touch-sensitive panel display 10 e.Meanwhile, in the third embodiment, the image forming apparatus 1analyzes an air gesture. The “air gesture” herein is a gesturerepresented with movement of a finger in a front space of thetouch-sensitive panel display 10 e. The air gesture does not involveactually touching the touch-sensitive panel display 10 e.

According to the third embodiment, the image forming apparatus 1distinguishes, in particular, between air tap and air flick. The “airtap” herein means a gesture in which a user pretends to make a tapgesture. To be specific, the air tap is a gesture in which the userbrings his/her finger closer to the touch-sensitive panel display 10 ewithout touching the same and immediately draws the finger thereaway.The “air flick” herein means a gesture in which the user pretends tomake a flick gesture. To be specific, the air flick is a gesture inwhich the user brings his/her finger closer to the touch-sensitive paneldisplay 10 e without touching the same and quickly moves the finger inparallel with the display surface of the touch-sensitive panel display10 e.

The configuration of the intranet 3 according to the third embodiment isthe same as that of each of the first and second embodiments shown inFIG. 1. The hardware configuration and functional configuration of theimage forming apparatus 1 in the third embodiment are basically the sameas those of the first embodiment and the second embodiment shown in FIG.2 and FIG. 3, respectively. Note however that, as shown in FIG. 17, thegesture analyzing portion 101 is configured of an air tap thresholdstorage portion 151, an air tap threshold read-out portion 152, a motioncharacteristics information obtaining portion 153, a first distancecomparison portion 154, a second distance comparison portion 155, agesture identifying portion 156, and so on.

As shown in FIG. 18, the air tap threshold storage portion 151 stores,therein, air tap threshold data 5PF on a screen-by-screen basis. The airtap threshold data 5PF indicates a screen identifier Gi, a displaysurface distance threshold Dmax_c, and a vertical axis distancethreshold Dmin_c. The display surface distance threshold Dmax_c and thevertical axis distance threshold Dmin_c are thresholds used todistinguish between air tap and air flick.

When the video camera 10 n detects a finger, the air tap thresholdread-out portion 152 through the gesture identifying portion 156 performprocessing in a manner as shown in FIG. 19.

The air tap threshold read-out portion 152 reads out air tap thresholddata 5PF on the current screen from the air tap threshold storageportion 151 (Step #731)

The motion characteristics information obtaining portion 153 analyzes afinger image captured by the video camera 10 n, and thereby, determinesa finger travel distance Dc1 on a plane (XY-plane) parallel with thedisplay surface of the touch-sensitive panel display 10 e and a fingertravel distance Dc2 in the vertical direction (Z-axis) on the displaysurface thereof (Step #732).

The first distance comparison portion 154 compares the travel distanceDc1 with a display surface distance threshold Dmax_c indicated in theair tap threshold data 5PF, and judges whether or not the traveldistance Dc1 is smaller than the display surface distance thresholdDmax_c (Step #733).

If the travel distance Dc1 is smaller than the distance threshold Dmax_c(Yes in Step #734), then the second distance comparison portion 155compares the travel distance Dc2 with a vertical axis distance thresholdDmin_c indicated in the air tap threshold data 5PF, and judges whetheror not the travel distance Dc2 is smaller than the vertical axisdistance threshold Dmin_c (Step #735).

The gesture identifying portion 156 identifies the type of an airgesture in accordance with the results of determination by the firstdistance comparison portion 154 and the second distance comparisonportion 155. The gesture identifying portion 156 determines as follows.If the travel distance Dc1 is smaller than the display surface distancethreshold Dmax_c (Yes in Step #734), and at the same time, if the traveldistance Dc2 is smaller than the vertical axis distance threshold Dmin_c(Yes in Step #736), then the gesture identifying portion 156 determinesthe air gesture to be an air tap gesture (Step #737). On the other hand,if the travel distance Dc1 is equal to or smaller than the distancethreshold Dmax_c (No in Step #734), or, alternatively, if the traveldistance Dc2 is equal to or smaller than the vertical axis distancethreshold Dmin_c (No in Step #736), then the gesture identifying portion156 determines the air gesture to be an air flick gesture (Step #738).

The description goes on to a difference between the determinationresults of gestures while a comparison is made between a case where thedocument transmission screen 61 shown in FIG. 6 is displayed and a casewhere the job history check screen 62 shown in FIG. 7 is displayed.

The layouts, uses, and so on of the document transmission screen 61 andthe job history check screen 62 are the same as those discussed earlier.In the third embodiment, however, air tap is used instead of tap, andair flick is used instead of flick.

Therefore, while the document transmission screen 61 is displayed, atendency in which a gesture made by the user is determined to be an airflick gesture is preferably higher than usual.

In view of this, a value smaller than a distance default value Do_c1 (ingeneral, standard value of change in position on the XY-plane toleratedas air tap) is preset, as the display surface distance threshold Dmax_c,in the air tap threshold data 5PF (see FIG. 18) for the documenttransmission screen 61. Hereinafter, the preset value is referred to asa “distance threshold d611”. Further, a value smaller than a distancedefault value Do_c2 (in general, standard value of change in position inth Z-axis direction tolerated as air tap) is preset as the vertical axisdistance threshold Dmin_c. Hereinafter, the preset value is referred toas a “distance threshold d612”.

On the other hand, while the job history check screen 62 is displayed, atendency in which a gesture made by the user is determined to be an airtap gesture is preferably higher than usual.

In view of this, a value greater than the distance threshold d611 or avalue greater than the distance default value Do_c1 is preset, as thedisplay surface distance threshold Dmax_c, in the air tap threshold data5PF for the job history check screen 62. Hereinafter, the preset valueis referred to as a “distance threshold d621”. Further, a value greaterthan the distance threshold d612 or a value greater than the distancedefault value Do_c2 is preset as the vertical axis distance thresholdDmin_c. Hereinafter, the preset value is referred to as a “distancethreshold d622”.

As discussed above, the distance threshold d621 is smaller than thedistance threshold d611. The distance threshold d622 is smaller than thedistance threshold d612. Therefore, according to the processing shown inFIG. 19, it is more often determined that a gesture made by the user isan air flick gesture in a case where the document transmission screen 61is displayed than in a case where the job history check screen 62 isdisplayed. This is known from the comparison between FIG. 20A and FIG.20B. Further, it is more often determined that a gesture made by theuser is an air tap gesture in a case where the job history check screen62 is displayed than in a case where the document transmission screen 61is displayed. This is also known from the comparison between FIG. 20Aand FIG. 20B.

Referring back to FIG. 17, the screen display control portion 102 andthe job execution control portion 103 operate in a manner similar tothose in the first and second embodiments. Note that, as the result ofdetermination of the gesture, the result of determination by the gestureidentifying portion 156 is used.

According to the third embodiment, it is possible to distinguish betweenair tap and air flick on a screen-by-screen basis more appropriatelythan is conventionally possible. This causes less inconvenience to usersthan with conventional methods, or, improves the user-friendliness ascompared to conventional methods.

FIG. 21 is a flowchart depicting a modification of the flow ofprocessing for distinguishing between tap and flick.

In the first through third embodiments, rules used to distinguishbetween gestures are made different for each screen by changing thethresholds. Instead of this, however, it is possible to make such rulesbe different by changing another item other than the thresholds.

For example, different algorithms for distinguishing between gesturesmay be used for each screen. To be specific, in the first embodiment,the algorithm shown in FIG. 5 is used as an algorithm for distinguishingbetween tap and flick on the document transmission screen 61. On theother hand, such an algorithm depicted in FIG. 21 is used as analgorithm for the job history check screen 62. According to thealgorithm, if at least one of distance conditions and time conditions issatisfied (Yes in Step #744 or Yes in Step #746), a gesture isdetermined to be a tap gesture.

Alternatively, it is possible to change, for each screen, parameters(finger travel distance, finger travel time, and so on) used fordistinguishing between gestures. For example, in the third embodiment,if the current screen is the job history check screen 62, conditions fortravel distance in a plane parallel with the display surface of thetouch-sensitive panel display 10 e are not used, and instead, conditionsfor travel distance in the vertical direction may be referred to.

In the first through third embodiments, two parameters are used todistinguish between gestures. Instead of this, however, one parametermay be used to distinguish between gestures. Three or more parametersmay be used to distinguish between gestures.

In the first embodiment, tap and flick are distinguished from eachother. In the second embodiment, press and drag are distinguished fromeach other. The present invention is applicable to a case where tap andpress are distinguished from each other, and also to a case where flickand drag are distinguished from each other. In such cases, thresholdsfor duration of touch are mainly changed on a screen-by-screen basis. Inorder to increase a tendency in which a gesture is determined to be atap gesture or a flick gesture, thresholds are preferably set to have alarge value.

The present invention is also applicable to a case where gesturesrepresented through a multi-finger motion (multi-touch gestures) aredistinguished from each other.

For example, the present invention is applicable to a case where tapwith two fingers and flick with two fingers are distinguished from eachother. In such a case, a travel distance or a travel time is comparedwith a threshold as with the first embodiment.

The present invention may be also used to distinguish between pinch andscroll with two fingers (gesture of moving two fingers in a parallelfashion). In such a case, a change ratio of distance between two fingersis detected. If the absolute value of the change ratio is smaller than athreshold, then the gesture is determined to be scroll with two fingers.If the absolute value of the change ratio is equal to or greater thanthe threshold, then the gesture is determined to be pinch. In order toincrease a tendency in which a gesture is determined to be scroll withtwo fingers, the threshold is set to have a large value. In contrast, inorder to increase a tendency in which a gesture is determined to bepinch, the threshold is set to have a small value.

In the third embodiment, the video camera 10 n is used to detect afinger travel distance. Instead of this, the detection may be made byusing a controller with a three-axis acceleration sensor (for example,Wii remote controller provided by Nintendo Co., Ltd. or iPhone providedby Apple, Inc.), a three-dimensional gesture controller (for example,Leap Motion Controller provided by Leap Motion, Inc.), and so on.

The first through third embodiments are described by taking an examplein which a user directly operates the image forming apparatus 1. Thepresent invention is also applicable to a case where a user remotelyoperates the image forming apparatus 1 via the terminal 2. In such acase, the terminal 2 executes processing for identifying a gesture, andthe result of determination is sent to the image forming apparatus 1,and then, the image forming apparatus 1 are supplied with commands ordata. Alternatively, the terminal 2 sends data on motion to the imageforming apparatus 1, and the motion characteristics informationobtaining portion 123, 133, or 153 of the image forming apparatus 1 (seeFIGS. 3, 9 and 17) receives the data. After that, the gestureidentifying portion 126, 136, or 156 performs processing for identifyinga gesture in the manner discussed above.

According to the first through third embodiments, it is possible tobring benefits to users in a device which performs processing based on agesture.

It is to be understood that the configurations of intranet 3 and theimage forming apparatus 1, the constituent elements thereof, the contentand order of the processing, the configuration of data, the structure ofscreens and the like can be appropriately modified without departingfrom the spirit of the present invention.

While example embodiments of the present invention have been shown anddescribed, it will be understood that the present invention is notlimited thereto, and that various changes and modifications may be madeby those skilled in the art without departing from the scope of theinvention as set forth in the appended claims and their equivalents.

What is claimed is:
 1. A device for determining a gesture, comprising: adisplay device to selectively display one of a plurality of differentscreens; a storage device to store a plurality of different respectiverules used for distinguishing between gestures, each of the plurality ofdifferent screens corresponding to a distinct one of the plurality ofdifferent respective rules; a detector to detect a motion made by auser, and a hardware processor configured to identify, from among thegestures, a gesture represented by the detected motion based on therespective rule for a current screen, the current screen being one ofthe plurality of different screens and being displayed at a time whenthe motion has been detected, wherein the detector includes atouch-sensitive panel, and detects, as the motion, a position touched bya user finger on the touch-sensitive panel at predetermined timeintervals, the storage device stores, as the respective rule, a distancethreshold, and the hardware processor determines that a gesturerepresented by the motion is a first gesture or determines that agesture represented by the motion is a second gesture based on a traveldistance of the user finger calculated based on the position detected bythe detector and the distance threshold.
 2. The device according toclaim 1, wherein the display device displays, as one of the plurality ofdifferent screens, a destination selection screen on which buttons usedfor the user to select a data destination through a first gesture appearin order by scrolling in accordance with a second gesture made by theuser, and the storage device stores, as the respective rule for thedestination selection screen, a rule according to which a gesturerepresented by the motion tends to be determined to be the secondgesture in a case where the current screen is the destination selectionscreen as compared to a case where the current screen is anotherdifferent screen.
 3. The device according to claim 1, wherein thedisplay device displays, as one of the plurality of different screens, ajob list screen on which buttons used for the user to select a job ofwhich attributes are to be outputted through a first gesture appear inorder by scrolling in accordance with a second gesture made by the user,and the storage device stores, as the respective rule for the job listscreen, a rule according to which a gesture represented by the motiontends to be determined to be the first gesture in a case where thecurrent screen is the job list screen as compared to a case where thecurrent screen is another different screen.
 4. The device according toclaim 1, wherein the first gesture is tap, and the second gesture isflick.
 5. The device according to claim 1, wherein the first gesture ispress, and the second gesture is drag.
 6. The device according to claim1, further comprising a video camera to detect a motion made by theuser, wherein the first gesture is air tap, and the second gesture isair flick.
 7. The device according to claim 1, wherein the hardwareprocessor determines that a gesture represented by the motion is a firstgesture if a travel distance of the user finger calculated based on theposition detected is smaller than the distance threshold, and determinesthat the gesture is a second gesture if the travel distance is greaterthan the distance threshold.
 8. The device according to claim 7, whereinthe display device displays, as one of the plurality of differentscreens, a destination selection screen on which buttons used for theuser to select a data destination through the first gesture appear inorder by scrolling in accordance with the second gesture made by theuser, and the storage device stores, as the distance threshold for thedestination selection screen, a distance threshold having a valuesmaller than that of the distance threshold for another type of screen.9. The device according to claim 7, wherein the display device displays,as one of the plurality of different screens, a job list screen on whichbuttons used for the user to select a job of which attributes are to beoutputted through the first gesture appear in order by scrolling inaccordance with the second gesture made by the user, and the storagedevice stores, as the distance threshold for the job list screen, adistance threshold having a value greater than that of the distancethreshold for another different screen.
 10. The device according toclaim 1, wherein the detector includes a touch-sensitive panel, anddetects, as the motion, a position touched by a user finger on thetouch-sensitive panel at predetermined time intervals, the storagedevice stores, as the respective rule, a time threshold, and thehardware processor determines that a gesture represented by the motionis a first gesture if a duration of touch during which the position iscontinuously detected by the detector is greater than the timethreshold, and determines that the gesture is a second gesture if theduration of touch is smaller than the time threshold.
 11. The deviceaccording to claim 10, wherein the display device displays, as one ofthe plurality of different screens, a destination selection screen onwhich buttons used for the user to select a data destination through afirst gesture appear in order by scrolling in accordance with a secondgesture made by the user, and the storage device stores, as the timethreshold for the destination selection screen, a time threshold havinga value greater than that of the time threshold for another differentscreen.
 12. The device according to claim 10, wherein the display devicedisplays, as one of the plurality of different screens, a job listscreen on which buttons used for the user to select a job of whichattributes are to be outputted through a first gesture appear in orderby scrolling in accordance with a second gesture made by the user, andthe storage device stores, as the time threshold for the job listscreen, a time threshold having a value smaller than that of the timethreshold for another different screen.
 13. The device according toclaim 7, wherein the first gesture is tap, and the second gesture isflick.
 14. The device according to claim 7, wherein the first gesture ispress, and the second gesture is drag.
 15. The device according to claim1, wherein the detector detects, as the motion, a position of a userfinger in a three-dimensional space at predetermined time intervals, thestorage device stores, as the respective rule, a distance threshold, andthe hardware processor determines that a gesture represented by themotion is air flick if a travel distance of the user finger in avertical direction of a display surface of the display device calculatedbased on the position detected by the detector is greater than thedistance threshold, and determines that the gesture is air tap if thetravel distance is smaller than the distance threshold.
 16. The deviceaccording to claim 1, wherein the detector detects, as the motion, aposition of a user finger in a three-dimensional space at predeterminedtime intervals, the storage device stores, as the respective rule, adistance threshold, and the hardware processor determines that a gesturerepresented by the motion is air flick if a travel distance of the userfinger on a plane parallel with a display surface of the display devicecalculated based on the position detected by the detector is greaterthan the distance threshold, and determines that the gesture is air tapif the travel distance is smaller than the distance threshold.
 17. Thedevice according to claim 15, wherein the display device displays, asone of the plurality of different screens, a destination selectionscreen on which buttons used for the user to select a data destinationthrough the air tap appear in order by scrolling in accordance with theair flick made by the user, and the storage device stores, as thedistance threshold for the destination selection screen, a distancethreshold having a value smaller than that of the distance threshold foranother different screen.
 18. The device according to claim 15, whereinthe display device displays, as one of the plurality of differentscreens, a job list screen on which buttons used for the user to selecta job of which attributes are to be outputted through the air tap appearin order by scrolling in accordance with an air gesture made by theuser, and the storage device stores, as the distance threshold for thejob list screen, a distance threshold having a value greater than thatof the distance threshold for another different screen.
 19. A device fordetermining a gesture, comprising: a receiving device configured toreceive, from a portable terminal including a display device forselectively displaying one of plurality of different screens and adetector for detecting a motion made by a user, the motion detected bythe detector; a storage device to store a plurality of differentrespective rules used for distinguishing between gestures, each of theplurality of different screens corresponding to a distinct one of theplurality of different respective rules; and a hardware processorconfigured to identify, from among the gestures, a gesture representedby the motion received by the receiving device based on the respectiverule for a current screen, the current screen being one of the pluralityof different screens and being displayed at a time when the motion hasbeen detected, wherein the detector includes a touch-sensitive panel,and detects, as the motion, a position touched by a user finger on thetouch-sensitive panel at predetermined time intervals, the storagedevice stores, as the respective rule, a distance threshold, and thehardware processor determines that a gesture represented by the motionis a first gesture or determines that a gesture represented by themotion is a second gesture based on a travel distance of the user fingercalculated based on the position detected by the detector and thedistance threshold.
 20. A method for determining which one of gesturesis made by a user of a display device for selectively displaying one ofplurality of different screens and a detector for detecting a motion,the method comprising: storing in a storage device, a plurality ofdifferent respective rules used for distinguishing between the gestures,each of the plurality of different screens corresponding to a distinctone of the plurality of different respective rules; detecting, by thedetector, the motion made by the user; and identifying by a computer,from among the gestures, a gesture represented by the motion detected bythe detector based on the respective rule for a current screen, thecurrent screen being one of the plurality of different screens and beingdisplayed at a time when the motion has been detected, wherein thedetector includes a touch-sensitive panel, and detects, as the motion, aposition touched by a user finger on the touch-sensitive panel atpredetermined time intervals, the storage device stores, as therespective rule, a distance threshold, and the computer determines thata gesture represented by the motion is a first gesture or determinesthat a gesture represented by the motion is a second gesture based on atravel distance of the user finger calculated based on the positiondetected by the detector and the distance threshold.
 21. Anon-transitory computer-readable storage medium storing thereon acomputer program used in a computer, the computer being connectable to adisplay device for selectively displaying one of plurality of differentscreens, a storage device for storing, a plurality of differentrespective rules used for distinguishing between gestures, each of theplurality of different screens corresponding to a distinct one of theplurality of different respective rules, and a detector for detecting amotion, the computer program causing the computer to perform processingcomprising: identifying, from among the gestures, a gesture representedby the motion detected by the detector based on the respective rule fora current screen, the current screen being one of the plurality ofdifferent screens and being displayed at a time when the motion has beendetected, wherein the detector includes a touch-sensitive panel, anddetects, as the motion, a position touched by a user finger on thetouch-sensitive panel at predetermined time intervals, the storagedevice stores, as the respective rule, a distance threshold, and thecomputer determines that a gesture represented by the motion is a firstgesture or determines that a gesture represented by the motion is asecond gesture based on a travel distance of the user finger calculatedbased on the position detected by the detector and the distancethreshold.
 22. The device according to claim 1, wherein according toeach of the respective rules, the gesture represented by the detectedmotion is determined to be a gesture corresponding to a scrollingoperation rather than a gesture corresponding to a selecting operationat least in part based on the current screen having a priority placed onscrolling as compared to a case where the current screen has a priorityplaced on selecting, and the gesture represented by the detected motionis determined to be the gesture corresponding to the selecting operationrather than the gesture corresponding to the scrolling operation atleast in part based on the current screen having a priority placed onselecting as compared to a case where the current screen has a priorityplaced on scrolling.